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ABSTRACT 

This guide was developed to help improve the 
decision-making ability of educators who evaluate innovations. It 
suggests evaluative criteria for assessing an educational innovation. 
The format allows the evaluator to analyze the benefits and costs of 
an innovation step-by-step by providing information for the 
applicable innovation characteristics. Developers and promoters of 
exemplary innovations could use the categories in the guide to 
furnish consumer information on their products. A worksheet for major 
cost items is included. A related document is available as VT 015 606 
(RIE* January 1973) . (MF) 
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WHAT IT IS 



The Innovations Evaluation Guide is an instrument to help improve 
the decision-making ability of educators who evaluate innovations. 
The Guide classifies innovations by their characteristics in a 
manner which facilitates their evaluation by potential adopters. 



WHY IT WAS DEVELOPED 

Educators often lack pertinent information upon which to base 
their decisions. Use of this Guide will reduce the risk of fail- 
ure due to an oversight in considering essential information. 
This aid to making a more rational decision suggests evaluative 
criteria for assessing an innovation. 



HOW IT WORKS 

The format of the Guide allows the evaluator to do a step-by-step 
analysis of the benefits and costs of an innovation. By providing 
information for the applicable characteristics, the evaluator can 
gain support and approval from those who are affected by his deci- 
sion. Developers and promoters of exemplary innovations can use 
the categories in the Guide to supply consumer information on 
their products. 



WHO CAN USE IT 



The Guide can be used by any educator who has the task of eval- 
uating innovations. Potential users include such people as class- 
room teachers, school administrators, state supervisors of exem- 
plary programs, local educational agency project directors, state 
department personnel, teacher educators, research and development 
center personnel, and research coordinating unit personnel. 
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WHEN TO USE IT 



Educators should find the Guide most helpful when an innovation 
needs to be considered for adoption. It can also be useful as 
an evaluation tool to assess an innovation which is in the trial 
stage of adoption. 



WHAT IT IS NOT 

This Guide does not attempt to assess community or organization 
ne ® < ??. for . innovations * The identification of problems and the 
mobilization of resources are the prerogatives of decision-makers 



Since the purpose of this Guide is to assess innovations 
rather than local situations, the educator must know his 
needs and be able to identify problems which exist. At 
this point, the Guide is useful in evaluating innovations 
as possible solutions to the perceived problems. 



Information on the development of the Innovations Evalua- 
tion Guide can be obtained from the Final Report, The 
Classificati on and Evaluation of Innovations in Vocational 
and Technical Education , Research Series No. 71 I This 
research was conducted at The Center for Vocational and 
Technical Education, The Ohio State University, by William 
L. Hull, principal investigator, and Randall L. Wells, re- 
search associate. 

A limited number of single copies are available upon re- 
quest from the Product Utilization Specialist at The Center. 
Permission to duplicate this Guide will be granted by The 
Center upon request. 
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BENEFITS 



INDIVIDUAL PUPIL GROWTH 

« Rate of Leariiint) 

What effect will the innovation have on the rate of student 
learning? 

© Scope of Learning 

How does the innovation affect the number and type of learn- 
ing experiences and/or skills to which the students will be 
exposed? 

© Attitude 

What effect on attitudes can be attributed to the innovation 
(i.e., community, students, teachers, administrators)? Are 
there any experiences which assist the students in the 
development of their self —concepts and their abilities to re’ 
late to other individuals? 



PROGRAM OPERATIONS 

© Efficiency 

What information is available which will allow a cost/benefit 
analysis of the innovation? How does this analysis compare 
to the present status or other alternatives? 

© Effectiveness 

What evidence indicates the innovation can achieve the re- 
quired objectives to our satisfaction? 



SOCIETY AND THE ECONOMY 

o Entry and Advancement in an Occupation 

What effect does the innovation have on increasing the oppor- 
tunities to acquire job entry skills? Does the innovation 
include activities which will contribute to promotion and 
satisfaction on the job? 

o Economic and Social Efficiencies 

What effect will the innovation have on productivity and costs 
to society in relation to such items as v:ages, occupational 
mobility, and school dropout rate? 

© Social Values 

What attempts will be made to create an awareness of society 
in the students through the teaching of concepts concerning 
institutions, laws , cultures and social problems? 

© Community Involvement 

What benefits will accrue to the school and community after 
installing the innovation? What effect will the innovation 
have on such items as school and community relations, and 
the public image of the school? 
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CREDIBILITY 

® Validity , . 

What evidence indicates that the innovation can achieve its 
objectives? 

o Reliability . 

Where has the innovation been tested previously? How similar 
are these settings to our situation? 



ASSURANCE CONTRACT 

• Wari.vty _ 

To wc t extent does the developer and/or promoter warrant the 
soundness of the innovation? Who is responsible for assuring 
the services of the innovation? 



What types of consultation and services are provided by the 
sponsoring agency to warrant the product? 



COSTS 

FUNDING 

* Costs 

What is the cost per unit over time? Will the innovation in- 
volve a saving? 

* Sources of Dollars 

How can the innovation be funded? Must the cost be borne 
locally, or is assistance available wholly or in part from 
state, federal, or public sources such as foundations? What 
are the possibilities of reallocating present budget items to 
accommodate installation? 

« Availability of Dollars 

What processes and/or procedures must be followed to acquire 
the necessary funding? Is the local educational agency in a 
position to expend its own money and be reimbursed later, or 
are funds from other sources available prior to expenditure? 

* Proportion of Dollars Available from Different Sources 

In what proportion are funds available from other sources? 

Do matching funds have to be local funds? 

e Limitations of Use of Other than Local Funds 

What limitations are placed on the use of other funds? Can 
funds be used for instruction only, equipment and instruction, 
or equipment, supplies and instruction? Can funds be used 
for items such as construction, food, transportation or con- 
sultants? 
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TIME CONSIDERATIONS 

a Installation Time 

liow much time does it take to get the innovation working? 

« Lead Time 

What deadlines are placed on activities prior to the operating 
date? How much time is necessary to order and receive items 
such as texts and materials? How much time is necessary to 
order , receive, and install equipment? Will the innovation 
require teacher orientation or advanced teacher planning time? 

» Planning Time 

How much time must be devoted to planning by a teacher, coor- 
dinator or administrator during each week? 

® Operation Time 

What amount of time is required by the innovation in daily 
preparation, classroom activities, meetings, etc.? 

° Cyclical Considerations 

What characteristics of the innovation dictate that it be in- 
stalled at a particular * t mo during the calendar or academic 
year? 

INSTALLATION CONSIDERATIONS 

“Acceptance 

What barriers can be anticipated from the community, school 
personnel, or students concerning the installation of the 
innovation? 

• Complexity 

What is the extent of involvement necessary to install the 
innovation? How many staff members, students, schedules, 
classrooms, laboratories, or schools are involved? 

• Divisibility 

What are the requirements concerning extent of installation? 
Can it be trial tested by the adopting unit before complete 
installation of the total product? 

• Policy Changes 

What changes in policy on the state and local level are nec- 
essary in order for the innovation to be successful? (i.e., 
procedure for a field trip on local level? certification 
changes on state level) 

8 



non 




i 

j 





9 



INSTALLATION CONSIDERATIONS (cont.) 

« Dugiee of Development 

X s the innovation in an installable form or does it require 
more development? Are additional materials or training 
activities necessary? 

©• Feasibility 

What evidence is there to indicate that the innovation will 
work in our situation? 

© Adaptability 

What adjustments can be made to meet local conditions with- 
out damaging the authenticity of the innovation? 

ORGANIZATIONAL CHANGE 

© Disruption of Routine 

What interruption of routine is required by the innovation 
due to rescheduling of classes, retraining of teachers, 
sharing of facilities, etc.? 

o Effect on Staff Orgum/ation 

What effect will the innovation have on the present structure? 
Does it create a need for a separate division or department? 

e- Rule Change for Individuals 

What changes in duties and/or responsibilities are necessary 
for successful operation of the innovation? 

thv/j Relationships among Groups 

What new kinds of relationships among departments or grade 
levels will be necessary for successful operation of the 
in'nova tion? 



PERSONNEL NEEDS 

o Quantity of Staff 

What additions to the staff are required? Ilow many part-time 
or full-time people per unit are needed? 

o Teaching or Other Experiences 

What staff experiences arc necessary for successful operation 
of the innovation? Do leaders need to ,’ave a knowledge of 
the community? 

® Personnel Development Required by the Innovation 

What requirements are necessary for the development of certain 
role attitudes, skills, ar.d competencies not presently pos- 
sessed by personnel? Is the present staff capable of, ana 
willing to handle the personnel development necessary for the 
success of the innovation? Are consultants available? 
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SPACE REQUIREMENTS 

15 Space (Housing) 

'2 re .? resent faci litics sufficient? If not, what phvsical 
facilities are necessary to house the innovation? 

* Space (Land Use) 

Khat acreage is necessary for installing the innovation? 

* Arrangement of Space to Other Programs 

Does the success of the innovation require close oroximity 
to ongoing programs or present facilities? On the other hand, 
is a separate location desirable? 

® Acquisition of Needed Space 

What are the options to acquiring needed space for the inno- 
vation? (i.e., donation, purchase, lease, rer.- build) 

EQUIPMENT REQUIREMENTS 

» Hardware 

What are the major items of equipment or their components 
necessary for the operation and success of the innovation? 

*» Software 

What supplies are necessary for the operation of the inno- 
vation? 
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Types of Costs 


Personnel: Administrative 


Instructional 


Cler ical 


Consultant 


(Other) I 


(Facilities: Building Space 


Equipment 


Supplies and Materials 


(Other) 


operating 
(Expenses : Travel 


Printing and Communications 


Repairs and Maintenance 


Overhead ! 


(Other) 
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Total Cost 

•Per Unit (i.e., cost per pupil, cost per school, or cost per state, etc.) 

Per Time (i.e., per instructional hour, per year, etc.) *Per Unit/Per Time 



The Innovation will benefit: 
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Students 
Teachers 
Administrators 
The School 
The Community 



The State 
The Economy 
Society 

Program Operations 
(Other) 



The Innovation is: 

Acceptable 

Feasible 

Adaptable 

Divisible 



Va 1 id 
Reliable 
War ran ted 
(Other) 



The installation requirements arc: 

Funding 

Staffing 

Housing 

Equipping 



THE OBJECTIVES FOR THIS INNOVATION ARE 



Organization Change 
Policy Change 
(Other) 
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